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(54) Reducing bandwidth and areas needed for non-inclusive memory hierachy by using dual 
tags 



(57) An apparatus and method for optimizing a non- 
inclusive hierarchical cache memory system that in- 
cludes a first and second cache for storing information. 
The first and second cache are arranged in an hierar- 
chical manner such as a level two and level three cache 
in a cache system having three levels of cache. The lev- 
el two and level three cache hold information non-inclu- 
sively, while a dual directory holds tags and states that 
are duplicates of the" tags and states held for the level 
two cache. All snoop requests (snoops) are passed to 
the dual directory by a snoop queue. The dual directory 
is used to determine whether a snoop request sent by 
snoop queue is relevant to the contents of level two 
cache, avoiding the need to send the snoop request to 
level two cache if there is a "miss" in the dual directory. 



This increases the available cache bandwidth that can 
be made available by second cache since the number 
of snoops appropriating the cache bandwidth of second 
cache are reduced by the filtering effect of dual directory. 

Also, the third cache is limited to holding read-only 
information and receiving write-invalidation snoop re- 
quests. Only snoops relating to write-invalidation re- 
quests are passed to a directory holding tags and state 
information corresponding to the third cache. Limiting 
snoop requests to write invalidation requests minimizes 
snoop requests to third cache, increasing the amount of 
cache memory bandwidth available for servicing catch 
fetches from third cache. In the event that a cache hit 
occurs in third cache, the information found in third 
cache must be transferred to second cache before a 
modification can be made to that information. 




Printed by Jouve, 75001 PARIS (FR) 



OCIO: <EP 0905627 A 1 J_> 



1 



EP 0 905 627 A1 



2 



Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001 ] The present invention relates to cache memo- 
ry systems. More particularly, the present invention re- 
lates to non-inclusive hierarchical cache memory sys- 
tems. 

2. Background 

[0002] Multi-processing computer systems that pair a 
hierarchical, inclusive cache unit for each processor are 
known. A typically configuration of one such multi- 
processing system is shown in FIG. 1 which includes 
processors 10-1 through 10-n, cache units 12-1 through 
12-n, main memory 13, and a snoop request bus 14. 
Such a multi-processing approach however does not 
fully maximize the potential instruction execution band- 
width that can be achieved by using multiple processors 
for at least two reasons: the use of the inclusion method 
in a hierarchical cache; and the need to maintain cache 
coherency among the cache units used. 
[0003] Inclusion is a method where each lower level 
cache contains data or instructions ("information") 
which is a superset of the information held by all the up- 
per levels of cache in the cache hierarchy The inclusion 
method imposes the following disadvantages which are 
compounded when the method is replicated in each 
cache unit in a multi-processor computer system. First, 
a large amount of silicon area is required because three 
bits are required to encode a state for each cache line 
used under the MOESI protocol which is described by 
Paul Sweazey and Alan Jay Smith in A Class of Com- 
patible Cache Consistency Protocols and their Support 
by the IEEE futurebus, IEEE, 1 996, hereby incorporated 
by reference. 

[0004] Second, maintaining inclusion incurs a large 
bandwidth or performance penalty that increases in pro- 
portion to the number of inclusive caches used in a 
cache unit because every cache line evicted from a low- 
er level cache requires all the subblocks within the lower 
level cache to be evicted from the upper level blocks. 
As defined in High Performance Memories, by Betty 
Prince, available from John Wiley & Sons, and is incor- 
porated herein by reference, a cache line consists of an 
address and the data corresponding to that address. A 
cache line, which may also be referred to as a cache 
block, is the minimum unit of information that can be 
moved between main memory and cache. 
[0005] For example, in an inclusive hierarchical cache 
unit having three levels "of cache such as a level one 
cache, a level two cache, and a level three cache, evict- 
ing a level three cache line requires all the subblocks 
within the level three cache to be evicted from the level 
two cache and the level once cache. If every level three 



cache line has a size of 51 2 bytes, every level two cache 
line would have a level two cache line size of 1 28 bytes. 
Thus, there are lour (4) subblocks of 128 bytes in each 
level three cache line which means that for each level 

s three cache line evicted, four replacement requests are 
generated for the level two cache to remove any poten- 
tial data copies stored in the level two cache. 
[0006] This generation of four replacement requests 
for every cache line evicted is propagated further along 

10 the hierarchy if a level one cache is also constrained to 
the inclusive method. In the above example, each level 
one cache line would be 32 bytes which results in four 
subblocks in level two. Thus, following the result above, 
a single level three cache line replacement results in 

is four replacement requests generated for the level two 
cache and 16 replacement requests generated for the 
level one cache. Thus, the inclusion method becomes 
very unwieldy very fast as more inclusive cache levels 
are used. The impact is that for a given cache unit size, 

20 with respect to the size of the individual levels of cache 
and the number of cache levels used, the inclusive 
method results in higher miss rates when compared with 
cache units that do not impose the inclusive method. 
Higher miss rates also result in higher potential write- 
rs back requests to main memory 

[0007] In addition to the above problem with inclusion, 
a multi-processor approach requires maintaining coher- 
ency between multiple copies of data held among cache 
units 12-1 through 12-n, if any. Maintaining coherency 

30 reduces the available memory bandwidth of the cache 
units because a portion of the available memory band- 
width is wasted servicing snoops that result from oper- 
ations that involve the modification of a copy of data held 
in one cache unit. 

35 [0008] Rather than using an inclusive hierarchical 
cache memory system, another approach uses a non- 
inclusive hierarchical cache but this also has drawbacks 
due to the amount of cache bandwidth that is expended 
in maintaining cache coherency between cache units. 

40 [0009] Hardware-based solutions to maintaining co- 
herence in a multiprocessor system include a central- 
ized or distributed approach. In a centralized approach, 
directory protocols maintain information about where 
copies of information reside in a centralized directory. 

45 The directory contains information about the contents- 
of local caches for the entire multi-processor system. A 
centralized controller keeps this information up to date 
and interacts with all of the local caches to ensure that 
data consistency is maintained. 

so [0010] In a distributed approach : "snoopy" protocols 
distribute the responsibility for maintaining cache coher- 
ence among all of the processors. The updates each 
processor makes to a shared memory block must be 
broadcast to all other processors. Each cache controller 

55 "snoops", or reads, these broadcast messages and up- 
dates its own cache accordingly. 

[0011] In the "snoopy" system, each individual proc- 
essor and its cache is connected to a shared system 
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bus that is connected to the shared main memory. As 
data operations are performed in each processor, the 
processor will broadcast these operations onto the 
shared system bus. For example, as a first processor 
performs read and write operations on shared data cop- 
ies located in its cache, it broadcasts this information to 
the system bus to alert other processors to update the 
status of their data copies. By "snooping" the system 
bus, a second processor knows that it must invalidate 
its copy of a piece of data after it receives the broadcast 
that the first processor has operated on that same piece 
of data. Other examples of the messages broadcast by 
processors onto the shared system bus are well known 
to those of ordinary skill in the art. 
[001 2] In the snoopy system, bandwidth may be wast- 
ed by servicing snoops arising from a write-invalidation 
sent by processor 10-1 after data in a cache line or block 
is modified in cache unit 1 2-1 . The snoops are detected 
by processors 10rn and are serviced by checking each 
of their cache units, 1 2-n, for any existing copies of the 
data just modified in cache unit 12-1 and if existing, re- 
moved from cache units 12-n. 

[001 3] In addition, due to the high instruction and data 
bandwidth required by having multiple processors, 
cache line state and tag information for all levels of 
cache should be quickly accessible so that snoop re- 
quests may be serviced promptly, minimizing read and 
write latency to the level two and three caches. Such 
multi-processor systems benefit from having cache 
state and tag information on the same silicon real estate 
as the processor {"on-chip"). However, having state and 
tag information "on-chip" reduces silicon real estate that 
can be made available for processor circuitry, rendering 
the approach expensive when compared to off-chip de- 
signs. 

[001 4] Accordingly, it would be desirable to provide an 
apparatus and method for optimizing a non-inclusive 
cache so that the amount of cache memory bandwidth 
expended for snoop protocols and the on-chip area 
needed to implement the apparatus and method are 
minimized. 

SUMMARY OF THE INVENTION 

[0015] The present invention is an apparatus and 
method for optimizing a non-inclusive hierarchical 
cache memory system. The invention includes a first 
and second cache for storing information which are ar- 
ranged in an hierarchical manner such as a level two 
and level three cache in a cache system having three 
levels of cache. The level two and level three cache hold 
information non-inclusively, while a dual directory holds 
tags and states that are duplicates of the tags and states 
held for the level two cache. All snoop requests (snoops) 
are passed to the dual directory by a snoop queue. Dual 
directory is used to determine whether a snoop request 
sent by snoop queue is relevant to the contents of level 
two cache, avoiding the need to send the snoop request 



to level two cache if there is a "miss" in the dual directory. 
This increases the available cache bandwidth that can 
be made available by second cache since the number 
of snoops appropriating the cache bandwidth of second 

5 cache are reduced by the filtering effect of dual directory. 
[0016] Also, the third dache is limited to holding read- 
only information and receiving write-invalidation snoop 
requests. Only snoops relating to write-invalidation re- 
quests are passed to a directory holding tags and state 

10 information corresponding to the third cache. Limiting 
snoop requests to write invalidation requests minimizes 
snoop requests to third cache, increasing the amount of 
cache memory bandwidth available for servicing catch 
fetches from third cache. In the event that a cache hit 

is occurs in third cache, the information found in third 
cache must be transferred to second cache before a 
modification can be made to that information. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 

[0017] FIG. 1 shows a multi-processor computer sys- 
tem having inclusive hierarchical cache units. 
[0013] FIG. 2 shows a multiprocessor system having 
non-inclusive hierarchical cache units employing a 
25 snoop-based coherency protocol in accordance with a 
preferred embodiment of the present invention. 
[0019] FIG. 3 shows a method of operation in accord- 
ance with a preferred embodiment of the present inven- 
tion. 

30 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

[0020] In the following description, a preferred em- 
35 bodiment of the invention is described with regard to 
preferred process steps and data structures. Those 
skilled in the art would recognize after perusal of this 
application that embodiments of the invention can be im- 
plemented using one or more general purpose proces- 
40 sors operating under program control, or special pur- 
pose processors adapted to particular process steps 
and data structures, and that implementation of the 
process steps and data structures described herein 
would not require undue experimentation or further in- 
45 vention. 

System Architecture 

[0021] FIG. 2 shows a multiprocessor system having 
50 non-inclusive hierarchical cache units employing a 
snoop-based coherency protocol in accordance with a 
preferred embodiment of the present invention. 
[0022] As shown in FIG. 2, a multiprocessor system 
20 includes processors 22-1 through 22-n and cache 
55 units 24-1 through 24-n which are grouped together in 
processor/cache unit combinations 26-1 through 26-n. 
To avoid over-complicating the following discussion, 
processor/cache unit combination 26-2 through 26-n 
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are intended to contain the same features as processor 
cache unit combination 24-1 and are thus not disclosed 
in detail but are intended to contain all of the novel fea- 
tures disclosed herewith. Each cache unit 24-1 through 
24-n in processor/cache unit combination 26-1 through 
26-n contains three levels of cache, first cache 28, sec- 
ond cache 30, and third cache 32 that are organized in 
hierarchical levels. 

[0023] The hierarchy level defined for each cache is 
dependent on the speed and size of each cache. The 
fastest cache, which is typically the smallest in the cache 
unit, is at the top level of the hierarchy and is referred 
toas the level one cache, while the slowest cache, which 
is typically the largest cache in the cache unit is at the 
bottom of the hierarchy. 

[0024] A level one cache is intended to hold informa- 
tion that is most likely-to be used frequently by the proc- 
essor. The lower cache levels, level two and/or level 
three, depending on the total number of caches a proc- 
essor has, are generally slower than the level one 
cache, but are able to hold more information. Thus a 
processor will first look for the information it needs in the 
level one cache, then the level two cache, and then the 
level two cache. In multiprocessor systems, if the data 
is not found in any of the cache levels a cache miss will 
be broadcast to the system bus to locate the information 
either in another processor's cache or in the main mem- 
ory. 

[0025] The cache hierarchy is defined with second 
cache 30 being below first cache 28 and third cache 32 
being below second cache 30. Because there are a total 
of three caches in cache unit 24, first cache 28, second 
cache 30, and third cache 32 are defined as level one, 
level two, and level three caches, respectively. First 
cache 28 and second cache 30 share the same silicon 
die 34 with processor 22-1 (on-chip), while third cache 
32 remains part of cache unit 24-1 through an external 
cache bus 36 (off -chip). Third cache 32 is not only a level 
three cache but may be referred to as an external cache. 
On-chip caches tend to be smaller with faster access 
times, whereas off-chip caches tend to be larger with 
slower access times. 

[0026] Level two cache and level three cache in cache 
unit 24-1 are non-inclusive with respect to each other, 
while level one cache may or may not be non-inclusive 
with respect to either level two cache and/or level three 
cache. In a non-inclusive cache hierarchy, the lower lev- 
el of the cache memory hierarchy does not necessarily 
contain the information held within all upper levels of 
cache. This provides the advantage of minimizing the 
number of tags and states that must be provided for 
each lower level of cache as compared to each lower 
level of cache in an inclusive cache hierarchy. In an in- 
clusive cache hierarchy, the lower level of the cache 
memory hierarchy is a superset of all of the upper levels. 
This results in the tags and states stored in cache direc- 
tories of upper levels of cache to be also stored in every 
lower level of cache used. The redundancy in states and 



tags creates rising overhead costs with respect to the 
size of the lower level cache directories and the speed 
in which these directories may be searched for a cache 
hit as the size of the lower level caches or number of 

5 caches increase. The use of non-inclusive caches 
avoids the overhead costs just described. 
[0027] Cache coherency is provided through a hard- 
ware solution using a snoop protocol. Snoops may be 
generated by processor/cache unit combination 26-1 or 

to from another processor/cache unit combination 26-n 
provided in the multi-processor system. Snoops arising 
from another processor are sent through a system re- 
quest bus 44. For each processor/cache unit combina- 
tion used, a snoop is generated each time information 
in the cache unit is changed or invalidated. Moreover, 
the snoop must be serviced by the other processor/ 
cache units to ensure that coherency is maintained. 
Consequently, snoop traffic within each cache unit in- 
creases as the number of cache units and processors 

2° (or equivalents) used in a multiprocessor computer sys- 
tem increases. 

[0028] To minimize the number of snoop requests 
(snoops) received by second cache 30 and third cache 
32 in cache unit 24-1 , a dual directory 38 is provided to 

25 filter snoops directed to second cache 30. All snoops 
are passed to dual directory 38 by snoop queue 40. This 
increases the available cache bandwidth that can be 
made available by second cache 30 since the number 
of snoops appropriating the cache bandwidth of second 

30 cache 30 are reduced by the filtering effect of dual di- 
rectory 38. 

[0029] If inclusion is maintained between first cache 
28 and second cache 30, snoops only need to be direct- 
ed to second cache 30, resulting in dual directory 38 also 

35 minimizing the amount of snoop traffic appropriating the 
bandwidth of first cache 28. As would be evident to one 
of ordinary skill in the art, if second cache 30 does not 
maintain inclusion of first cache 28 information (each 
cache level are non-inclusive with respect to each oth- 

40 er), snoops must also be sent to the first cache 28 be- 
cause the snoops would not be filtered out by dual di- 
rectory 38. All snoops are moved through the processor 
according to a FIFO scheme although this is not intend- 
ed to limit the invention in anyway. If a strict FIFO con- 

45 straint is used to process all snoops, later requests that 
could be quickly processed will be delayed by earlier re- 
quests that take more time to process. 
[0030] Due to the high instruction and data bandwidth 
required by having multiple processors, cache line state 

50 and tag information for all levels of cache should be 
quickly accessible so that snoops may be serviced 
promptly, minimizing read and write latency to the cach- 
es such as the level two and level three caches. Such 
multi-processor systems benefit from having cache 

55 state and tag information on the same silicon real estate 
as the processor ("on-chip"). However, having state and 
tag information "on-chip" reduces silicon real estate that 
can be made available for processor circuitry, rendering 
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the approach expensive when compared to off -chip de- 
signs. 

[0031] As discussed above, the number of states and 
tags required for a lower level cache in a non-inclusive 
hierarchical cache unit much less that the number of 
tags and states required under the inclusive method. In 
a cache coherency protocol maintained under MOESI, 
three states per tag are required. Authors Paul Sweazey 
and Alan Jay Smith describe the MOESI protocol in A 
Class of Compatible Cache Consistency Protocols and 
their Support by the IEEE futurebus : IEEE, 1996, which 
disclosure is hereby incorporated by reference. 
[0032] To further reduce the number of states per tag 
required to maintain coherency, third cache 32 is limited 
to holding read-only information and receiving write-in- 
validation snoop requests only in the present invention. 
This allows the number of states per tag to be reduced 
to a single bit, reducing the size of a directory 42 corre- 
sponding to third cache 32 and enabling directory 42 to 
be placed on-chip, further increasing the bandwidth of 
third cache 32 since directory 42 can be directly ac- 
cessed by processor 22-1 without going through exter- 
nal cache bus 36. 

[0033] Operating under read-only constraints pre- 
cludes store operations directed to a cache line in third 
cache 32 from being serviced unless the requesting cli- 
ent such as processor 22-2 asks for permission first. For 
example, under a MOESI cache coherency protocol, if 
a processor has a cached copy in an "exclusive" state, 
the processor can safely read and write to the data copy 
without checking other caches for another data copy or 
informing other processors (in a multiprocessor system) 
because the data copy is exclusive. When a processor 
has a "read-only" copy, it means that there is a potential 
that more than one data copy of the same memory lo- 
cation is kept in other caches in the system. 
[0034] In a multiprocessor system the write invalida- 
tions are sent using snoop requests to other processors. 
When a processor receives a snoop requesting a write 
invalidation, it removes the addressed data copy from 
its local cache, if one exists. Thus, the requesting proc- 
essor procures the "permission" or the "ownership" for 
the accessed location, giving the processor an exclusive 
copy of the information in the system. 
[0035] Limiting snoop requests to write invalidation 
requests minimizes snoop requests to third cache 32, 
increasing the amount of cache memory bandwidth 
available for servicing cache fetches Irom third cache 
32. In the event that a cache hit occurs in third cache 
32, the information found in third cache 32 must be 
transferred to second cache 30 before a modification 
can be made to that information. 

Method of Operation 

[0036] FIG. 3 shows a method of operation in accord- 
ance with a preferred embodiment of the present inven- 
tion. 



[0037] At step 60 tags and states corresponding to a 
first cache are created. For example, tags and states 
are created for information held by a level two cache. 
Also, the cache is defined to hold the information in a 

s non-inclusive manner since the tags and states corre- 
spond to information that are not necessarily a superset 
of an upper level cache such as a level two cache. 
[0038] At step 62, the tags and states corresponding 
to the first cache as described in step 60 are duplicated 

to and placed in a dual directory; 

[0039] At step 64 : the duplicated tags and duplicated 
states are used to filter snoop requests directed to the 
first ca^he. 

[0040 1 At step 66, tags and states are created for in- 
1$ formation held by a second cache. For example, tags 
and states may be created for information held by a level 
three cache such as an external cache. The level three 
external cache is defined to hold information in a non- 
inclusive manner. 
20 [0041 ] At step 68, snoop requests directed to the tags 
and states of the second cache are limited to write in- 
validation snoops only. 

[0042] In accordance with an alternative embodiment 
of the present invention the tags and states created for 

25 information held by the second cache in step 66 are 
stored in a directory which is held on-chip. 
[0043] While embodiments and applications of this in- 
vention have been shown and described, it would be ap- 
parent to those skilled in the art that many more modi- 

30 fications than mentioned above are possible without de- 
parting from the inventive concepts herein. The inven- 
tion therefore, is not to be restricted except in the spirit 
of the appended claims. 

35 

Claims 

1 . A method for optimizing a hierarchical cache mem- 
ory system, comprising the steps of: 

40 

creating tags and states corresponding to a first 
cache; 

creating duplicated tags and duplicated states 
by duplicating said tags and said states corre- 
sponding to said first cache; 
using said duplicated tags and said duplicated 
states to filter snoop requests directed to said 
first cache; 

creating tags and states corresponding to a 

50 second cache; 

filtering snoop requests directed to said second 
cache to write invalidation snoops only; and 
maintaining a non-inclusive cache procedure 
for said first cache and said second cache, 

55 wherein said first cache is at least one cache 

level above said second cache. 

2. The method in claim 1 , further including the step of 
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storing said tags and states corresponding to said 
second cache on the same silicon real estate as a 
corresponding processor. 

The method in claim 1, further including the step of s 
limiting ail cache operations to said second cache 
to read-only operations. 

The method in claim T, further including the step of 
creating tags and states corresponding to a third 10 
cache, wherein said third cache is at least one level 
above said first cache and at least two levels above 
said second cache in the hierarchical cache mem- 
ory system. 

15 

The method in claim 1 , further including a step of 
rendering said duplicated tags and said duplicated 
states corresponding to said first cache accessible 
by a system bus. 

20 

A method for optimizing a hierarchical cache mem- 
ory system, comprising the steps of: 

creating tags and states corresponding to a first 
cache; 25 
creating tags and states corresponding to a 
second cache, said first cache is at least one 
cache level above said second cache; 
creating duplicated tags and duplicated states 
by duplicating said tags and said states corre- 30 
sponding to said second cache, said second 
cache at least one cache level above said third 
cache; 

using said duplicated tags and said duplicated 
states to filter snoop requests directed to said 35 
second cache; 

creating tags and states corresponding to a 
third cache; 

filtering snoop requests directed to said third 
cache to write invalidation snoops only; and 40 
maintaining a non-inclusive cache procedure 
for said first cache, said second cache, and said 
third cache. 

The method in claim 6, further including the step of 45 
rendering said duplicated tags and said duplicated 
states in said second cache accessible to snoop re- 
quests transmitted on a snoop bus. 

The method in claim 6, further including the step of so 
storing said tags and states corresponding to said 
second cache on the same silicon real estate as a 
corresponding processor. 

The method in claim 6, further including the step of 55 
limiting all cache operations to said second cache 
to read-only operations. 



10. A method for optimizing a hierarchical cache mem- 
ory system, comprising the steps of: 

creating tags and states corresponding to a first 
cache; 

creating tags a*nd states corresponding to a 
second cache, said first cache is at least one 
cache level above said second cache; 
creating duplicated tags and duplicated states 
by duplicating said tags and said states corre- 
sponding to said second cache, said second 
cache at lear.t one cache level above said third 
cache; 

using said duplicated tags and said duplicated 
states to filter snoop requests directed to said 
second cache; 

creating tags and states corresponding to a 
third cache; 

filtering snoop requests directed to said third 
cache to write invalidation snoops only; 
maintaining a non-inclusive cache procedure 
for said first cache, said second cache, and said 
third cache; and 

storing said tags and states corresponding to 
said second cache on the same silicon real es- 
tate as a corresponding processor. 

11. The method in claim 10, further including the step 
of limiting all cache operations to said second cache 
to read-only operations 

12. An apparatus for optimizing a hierarchical cache 
memory system, comprising: 

a first cache for storing information; 
tags and states corresponding to said informa- 
tion; 

a dual directory having duplicate tags and du- 
plicates states which correspond to said infor- 
mation, said dual directory responsive to 
snoops; 

a second cache for storing information which is 
at least one level below said first cache, where- 
in said first cache and said second cache store 
said information in a non-inclusive manner; and 
a snoop queue responsive to snoops which in- 
cludes responding to snoops directed to said 
second cache by filtering out said snoops di- 
rected to said second cache other than snoops 
for write-in validation. 

1 3. The apparatus of claim 1 2, further including a direc- 
tory for holding tags and states corresponding to 
said information stored in second cache, said direc- 
tory held on the same silicon real estates as a cor- 
responding processor. 

14. The apparatus of claim 12, where said second 
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cache is limited to read-only transactions. 

15. The apparatus of claim 12, further including: 

a third cache for storing information; and 
tags and states corresponding to said informa- 
tion stored in said third cache, wherein said 
third cache is at least one level above said first 
cache and at least two levels above said sec- 
ond cache. 

16. The method in claim 12, further including a system 
bus. said system bus for sending snoops to said first 
cache, said second cache, and said third cache. 

17. An apparatus for optimizing a hierarchical cache 
memory system, comprising: 

tags and states corresponding to a first cache; 
tags and slates corresponding to a second 
cache, said first cache is at least one cache lev- 
el above said second cache; 
duplicate tags and duplicate states that are 
copies of said tags and said states correspond- 
ing to said second cache, said second cache at 
least one cache level above a third cache, said 
duplicate tags and said duplicate states used 
to filter snoop requests directed to said second 
cache; 

tags and states corresponding to said third 
cache; 

a snoop queue responsive to snoops directed 
to said third cache, said snoop queue limiting 
snoops to said third cache to write invalidation 
snoops only; and 

wherein a non-inclusive cache procedure is 
maintained for said first cache, said second 
cache, and said third cache. 

18. The apparatus in claim 17, further .including a sys- 
tem bus, said system bus for sending snoops to said 
first cache, said second cache, and said third 
cache. 

1 9. The apparatus of claim 17, further including a direc- 
tory for holding tags and states corresponding to 
said information stored in second cache, said direc- 
tory held on the same silicon real estates as a cor- 
responding processor. 

20: The apparatus of claim 17, where said second 
cache is limited to read-only transactions. 

21. An apparatus for optimizing a hierarchical cache 
memory system, comprising: 

tags and states corresponding to a first cache; 
tags and states corresponding to a second 



cache, said first cache is at least one cache lev- 
el above said second cache; 
duplicate tags and duplicate states that are 
copies of said tags and said states correspond- 
s ing to said second cache, said second cache at 

least one cache level above a third cache, said 
duplicate tags and said duplicate states used 
to filter snoop requests directed to said second 
cache; 

10 . tags and states corresponding to said third 

cache; 

a snoop queue responsive to snoops directed 
to said third cache, said snoop queue limiting 
snoops to said third cache to write invalidation 

15 snoops only; 

wherein a non-inclusive cache procedure is 
maintained for said first cache, said second 
cache, and said third cache; and 
a directory for holding tags and states corre- 

20 sponding to said information stored in second 

cache, said directory held on the same silicon 
real estates as a corresponding processor. 

22. The apparatus of claim 21 , where said second 
25 cache is limited to read-only transactions. 

23. A method for providing a computer system, com- 
prising the steps of: 

providing a non-inciusive hierarchical cache 
30 memory system including: 

a first cache for storing information; 
tags and states corresponding to said informa- 
tion; 

35 a dual directory having duplicate tags and du- 

plicates states which correspond to said infor- 
mation, said dual directory responsive to 
snoops; 

a second cache for storing information which is 
40 at least one level below said first cache, where- 

in said first cache and said second cache store 
said information in a non-inclusive manner; and 
a snoop queue responsive to snoops which in- 
cludes responding to snoops directed to said 
45 second cache by filtering out said snoops di- 

rected to said second cache other than snoops 
for write-invalidation. 

24. The apparatus of claim 23, wherein said first cache 
so and said second cache stores said information in a 

non-inclusive manner. 



OC1D: <EP 0905627 A I _(_> 



7 



EP 0 905 627 A1 



FIG. 1 




Multiple 
levels of 
Cache 



1 2-1 




1 0-2 



.1 0-n 



Multiple 
levels of 
Cache 



12-2 



Multiple 
levels of 
Cache 



1.2 -n 




Snoop Request Bus 14 
(Address & Commands) 



Prior Art 



DOCID: <EP 0905627A1_I_> 



8 



EP 0 905 627 A1 




EP 0 905 627 A1 



FIG. 3 



Step 60 



Create tags and states for information held by a first 
cache. 



Step 62 



v Duplicate the tags and states corresponding to the 
First cache and placed the duplicated tags and states 
in a dual directory. 



Step 64 



\^ Use the duplicated tags and duplicated states in the 
dual directory to filter snoop requests directed to the 
first cache. 



Step 66 



Create tags and states are created for information held 
by a second cache. 



Step 68 



\1/ 



Limit snoop requests directed to the tags and states of 
the second cache to write invalidation snoops only. 



10 



DOCID; <EP 0905627A1 J_> 



EP 0 905 627 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 30 7597 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
ol relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (tnt.CLfl) 



EP 0 481 233 A (IBM) 22 April 1992 



* column 3, 1 ine 41 - 1 i ne 50 * 

* column 9, line 56 - column 12, line 47; 
figures 5,6,8,168 * 



US 5 581 725 A (NAKAYAMA TAKASHI ) 
3 December 1996 

* column 4, line 23 -* line 30; figures 1,4 
* 

US 5 671 231 A (COOPER STEVE) 
23 September 1997 

* column 2 , 1 ine 40 - 1 ine 49 * 

* column 7, line 65 - column 8, line 6 * 



US 5 398 325 A (CHANG JUNG-HERNG 

14 March 1995 

* abstract; figure 2 * 



ET AL) 



The present search report has been drawn up for all claims 



1,4-7, 
12,- 
15-18, 
23,24 

2,3, 

8-11,13, 
14, 19-22 

2,8,10, 
13,19,21 



3,9,11 
14,20,22 



12,17, 
21,23 



G06F12/08 



TECHNICAL FIELDS 
SEARCHED <lnt.Cl.6) 



G06F 



Plact ol smatch 

THE HAGUE 



Date oi completion ol ttw search 

16 December 1998 



Examiner 

Ledrut, P 



CATEGORY OF CITED DOCUMENTS 

X ; particularly reievent if taken alone 

V : particularly r«ievant It combined with another 

document of the ca me category 
A : technological background 
O : non-wntten disclosure 
P : intermediate document 



T : theory orprinaple underling the invention 
E : earlier patent document but published on. or 

after the ming dare 
D : document cited in the application 
L : document cited tor other reasons 



& : morrow r ol me same patent family, correspond! no. 
document 



11 



OCtD; <EP 090552 7A\ J _> 



EP 0 905 627 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 98 30 7597 



This annex tists the patent family members relating to the patent documents cited in the above-mentioned European search report 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is In no way liable few these particulars which are merely given for the purpose of information. 

16-12-1998 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



Publication 



EP 0481233 



22-04-1992 



JP 



4230549 A 



19-08-1992 



US 5581725 



US 5671231 
US 5398325 



A 
A 



03-12-1996 



JP 



6110781 A 



23-09-1997 



NONE 



14-03-1995 



JP 



6131263 A 



22-04-1994 



13-05-1994 



-*Ktit this annex : see Official Journal of the European Patent Office, No. 12/82 



12 



